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[57] ABSTRACT 

In the past, contact imaging devices were large and costly. 
It has been proposed that for contact imaging device adop- 
tion for the personal computing market, cost and size must 
be reduced. In an attempt to address these concerns, a 
biometric pointing device such as a mouse is presented 
incorporating therein a contact imager. The contact imager 
fits within a small enclosure. Further, data transmission 
means within the mouse provides a signal to a single port on 
a computer indicative of the output data from both the 
contact imaging means and the pointing device. 

9 Claims, 27 Drawing Sheets 
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MOUSE ADAPTED TO SCAN BIOMETRIC 
DATA 

This application claims the benefit or U.S. Provisional 
Application No. 60/011,459, filed on Feb. 12, 1996. This is 
a continuation in part of U.S. patent application Ser. No. 
08/760,212, filed Dec. 4, 1996 now U.S. Pat. No. 5,859,420. 

FIELD OF THE INVENTION 

This invention relates to fingerprint identification, and in 
particular to an apparatus therefor included within a pointing 
device or computer housing adjacent a trackball. 

DESCRIPTION OF THE PRIOR ART 

Various optical devices are known which employ prisms 
upon which a finger whose print is to be identified is placed. 
Generally these systems rely on suitable optical components 
and adequate light for imaging. Imaging devices often 
include a prism that has a first surface upon which a finger 
having print to be detected is placed. A second surface is 
disposed at an acute angle to the first surface through which 
the fingerprint is viewed and a third illumination surface 
through which light is directed into the prism. In some cases, 
the illumination surface is at an acute angle to the first 
surface, as seen for example, in U.S. Pat. Nos. 5,187,482 and 
5,187,748. In other cases, the illumination surface is parallel 
to the first surface, as seen for example, in U.S. Pat. Nos. 
5,109,427 and 5,233,404. 

As fingerprint identification systems are becoming more 
in demand, their presence is increasing. One of the more 
basic and simple systems is described in U.S. Pat. No. 
5,187,748 as prior art FIG. la. For example, personal 
computer systems have been envisaged having fingerprint 
identification systems coupled to them for verifying autho- 
rised users, before access to a computer or computer system 
is given. Generally, fingerprint input devices tend to be quite 
bulky, large, and costly. 

It has been proposed that in theory, a smaller contact 
imaging device for inclusion in a mouse or joystick is 
preferable to those currently available. Further, with the 
emerging computer market, it has been proposed that these 
smaller contact imaging devices be incorporated into exist- 
ing computer peripherals such as pointing devices or key- 
boards. In U.S. Pat. No. 5,229,764 to Matchett et al., a 
computer mouse is shown in FIGS. Sa and Sb of that patent. 
The function of the mouse is described briefly and incorpo- 
rates a thumbscan sensor and a thumbscan processing unit 
separate from the computer and from the pointing device. 
The need for extra modules or units, renders such a system 
complex and expensive. Matchett, in describing a joystick 
incorporating a thumbscan sensor, discloses the use of two 
cables to the computer — it is assumed that one is for 
providing joystick data to a games port and the other is for 
providing thumbscan data to a thumbscan processing unit. 
For a joystick intended to rest on a surface, this may be a 
suitable solution; unfortunately, in home use, often joysticks 
are moved for comfort and for storage while not in use. Two 
cables are likely to become tangled or get caught. 

For the mouse incorporating a thumbscan unit, Matchett 
indicates that, "A mouse lead PE is modified, or replaced, to 
carry both mouse data and the sensor data/' No description 
of this modification is presented. In light of the disclosure of 
Matchett, it may indicate including two sets of wires or two 
cables within a single cable connecting a mouse to a 
computer via two connectors — therefore, splitting the cable 
proximate the computer into two separate cables — or, 
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alternatively, through a proprietary interface. This under- 
standing is reinforced with reference to FIG. Sb wherein 
Matchett discloses the use of a "same conduit" for carrying 
the leads of the thumbscan device. The use of a single 

s conduit is significant in preventing tangled mouse cables etc. 
Unfortunately, the Matchett reference does not teach an 
apparatus or method of designing or constructing a computer 
mouse incorporating a biometric sensor other than a sketch 
and suggestion that a thumbscan unit can be incorporated 

10 into a mouse. 

In the past, optical devices were interfaced with comput- 
ers through the use of frame grabbers or custom circuits. An 
optical imaging device such as a video camera or a finger- 
print sensor was provided with an opto-electronic compo- 

15 nent such as a charge coupled device (CCD) capable of 
transforming optical information in the form of images into 
electrical signals in the form of analogue output signals. 
Often, these signals correspond to existing standards such as 
RS170, NTSC or PAL. 

20 One popular use of this technology is in video cameras. A 
video camera comprises a lens, a CCD, and transformation 
circuitry. The camera is also provided with recording and 
playback means. In use, the CCD transforms an image 
presented to it through the camera lens into an electrical 

25 signal. The electrical signal is transformed to correspond 
with a predetermined analog video standard and is provided 
to an output port of the camera. Such an output signal is 
capable of being displayed on a television or on a security 
monitor. This output signal is also capable of being dis- 

30 played or imported into a computer by means of a frame 
grabber. 

Frame grabbers are known and are widely used. A frame 
grabber is designed to accept an analog video signal and 

35 convert same into a digital representation of a frame or a 
plurality of frames. Such a device converts a predetermined 
video signal from an analog signal to a digital bit map signal 
through the use of an analog to digital converter, synchro- 
nization circuitry, gray level recovery circuitry, sequencing 

4Q and control logic, and an interface to a computer bus. Such 
frame grabbers are often designed to be coupled with a 
personal computer and interface with the computer bus in 
the form of a NUBUS, ISA, PCI, or VLB bus. Typically, 
these frame grabbers require opening a PC's protective 

45 housing for installation and removal. Further, suc*h frame 
grabbers are costly. 

Electro-optical devices for use as biometric input devices 
such as fingerprint, retina, or palm scanners are known. In a 
fingerprint input transducer or sensor, the finger under 

50 investigation is usually pressed against a flat surface, such as 
a side of a glass plate, and the ridge and valley pattern of the 
finger tip is sensed by a sensing means such as an interro- 
gating light beam. Fingerprint identification devices of this 
nature are generally used to control the building-access or 

55 information-access of individuals to buildings, rooms, and 
devices such as computer terminals. 

The widespread use of personal computers and advances 
in processor power make them a suitable choice for many 
applications. Further, the expandability of some personal 

60 computers allows for the design and installation of periph- 
erals enhancing functionality or performance. Further yet, 
the adoption of standard desktop interfaces for computers 
such as Apple Desktop Bus, RS232, X.25, Ethernet, Parallel, 
Universal Serial Bus, SCSI, and Appletalk render the design 

65 and implementation of desktop peripherals which are 
removable from a computer and adaptable across different 
interfaces desirable. 
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This invention relates to a fingerprint input device that contact imaging means for imaging a fingerprint placed 

serves both as a computer pointing device in the form of a against the surface or window and providing imaging 

mouse and a fingerprint input device. For this and other information in dependence upon the imaging; 

similar applications, it is essential for the fingerprint input a relative ition mdicator for pr0 viding position infor- 

device to be, very compact, durable, and preferably inex- 5 malion in dependence upon posilion; 

pensive. To this end, it is an object of the invention to . . . , . 

provide a fingerprint capture device that is robust, has mcans for Priding a single signal to a computer in 

relatively few components and that is physically compact, dependence upon both the position information and the 

being relatively short in length between the prism to a imaging information. 

detecting array. According to yet another aspect of the invention there is 
Fingerprint imaging devices suitable for obtaining a fin- 10 provided a method of providing imaging and position infor- 

gerprint image from a live subject are well known in the mation from a computer pointing device to a computer 

literature. Similarly, mouse and other pointing devices are comprising the steps of: 

well known, common place computer accessories in desktop receiving position information; 

computers. This invention combines both of these devices in receiving image information; and, 

asynergistic manner. The benefits of doing so are _numeroi*. n^ing the image information and position informa- 

For example, the space reqmred on a desktop is significantly ^ ^ a ^ ^ d for ^ , 0 , he com . 

reduced compared with that required for separate devices; . A -j* *u _ • i . .u 

f . , . . , j . . . puter and providmg me composite signal to the com- 

the fingerprint scanning device is located in a position r ° 

naturally occupied by a thumb of a user, improving the 2Q 

repeatability of fingerprint imaging; as the fingerprint data BRIEF DESCRIPTION OF THE DRAWINGS 
arrives at the host computer through the same electronic port 

as the normal mouse data, valuable port resources are Exemplary embodiments of the invention will now be 

conserved in the host computer; no special electronic hard- described in conjunction with the drawings, in which: 

ware such as frame -grabber cards are required in the host 25 FIG. 1 is a prior art side elevation of an embodiment of 

computer to process the fingerprint data. In an application an apparatus for identifying fingerprints; 

where the fingerprint-mouse -pointing device are used in FIG. 2 is a prior art implementation of an imaging device 

combination with a screen saver to identify the user who left comprising a CCD and a frame grabber; 

a computer idle for a period of time, all that is required is the FIG. 3 is a simplified schematic diagrams of a mouse 

user placing a hand on the mouse with a finger or thumb on 3Q having an optical fingerprint imaging means incorporated 

the scanning window, and normal mouse control may be therein 

resumed, obviating the need to remove the users hand in - . . , . c . t c 

e ° c • j * FIG. 4 is a side elevation of an embodiment of an 
gomg from a separate fingerprint authorisation device to a 

* u . .« . apparatus according to the invention; 

mouse, thus significantly saving time. . . 

It is a further object of the invention to provide a relatively 35 FIG " 5 15 a ^ovation of yet another embodiment of an 

inexpensive device that is compact enough to be hand held, 35 W aratus accordlQ g to the invention; 

serving both as a mouse or pointing device, and a fingerprint FIG - 6 1S a Slde elevation of a lens having an opaque 

input device. The pointing device may be in the form of a coating about its periphery depicting a preferred embodi- 

trackpad, a joystick, a pen stylus, or a conventional mouse, menl °f ^is invention; 

furthermore, it may be incorporated into a laptop computer ^ FIG- 7 is a front view of the lens having a coating in the 

as part of the housing, with a platen or windowed surface for form of a fixed diaphragm applied to are area of the face of 

receiving a finger. the lens as is shown in FIG. 6 in accordance with the 

SUMMARY OF THE INVENTION "ctT? • r« am u,t r 

FIG. 8 is a simplified block diagram of a system according 

It is an object of the invention to provide a fingerprint t0 me invention* 

identification apparatus that is compact, relatively inexpen- 45 pjQ 9 fe a ^fied schematic diagram of a system 

sive and that, housed within a pointing device, focuses a accordin to the invention; 

fingerprint image onto a detector with acceptable clarity. * . .,./.,. ... 

* 4 . . • -j, FIG. 10 is a simplified schematic diagram of a system 

According to the invention, there is provided n apparatus j. * *l * *• * n / 

- c . . . c v . . .. , according to the invention incorporating a parallel pass 

for providmg fingerprint imaging information and positional 5Q mrou n orl> 

information for use with a computer, comprising: ^Jz . ' , , 

a hous'n • FIG. 11 is a computer rendered drawing of a hand held 

. . ' , . , „ fingerprint scanner for connection to a personal computer; 

a pointing device housed within the housing and for z^* _ . . . . , , . 

• j » a 4 . ,. , _j , FIG. 12 is a top view of the computer rendered drawing 

providmg a first signal in dependence upon location; . y & 

...... . , , . shown in FIG. 12; 

a contact imager housed within the housing and having a 55 ^„ „ . . . . 

surface for accepting fingerprint information and for FIG. 13 is a side view of the computer rendered drawing 

providing a second signal corresponding to detected snown m <J- » 

fingerprint information; and FIG - 14 is a simplified schematic diagram of a mouse 

means for accepting the first signal and the second signal havin S a ^ state means incorporated 

and for combining information from the first signal and 60 lnerem ' 

the second signal to provide a third signal to the FIG - 15 is a diagram of a track pad according to the 

computer. invention; 

In accordance with the invention there is provided an FIG.16isa simplified block diagram of the track pad 

apparatus for providing fingerprint imaging information and embodiment of the invention; 

positional information for use with a computer comprising: 65 FIG. 17 is a simplified flow diagram of a method of 

a housing, the housing having therein a window or surface encoding position information within image frames accord- 

for receiving a finger; ing to the invention; 
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FIG. 18 is a simplified flow diagram of a method of devices such as TEXAS INSTRUMENTS. Of note is the 

providing information to a computer, the method comprising fact that an electrical signal representative of a captured 

two distinct modes of operation according to the invention; image is provided by the CCD device in analogue form. This 

FIG. 19 is a side view of an optical apparatus for supports standards for video such as PAL or NTSC. 

identifying fingerprints; 5 Unfortunately, the use of a typical image capture apparatus 

HG. 20 is a schematic view of one embodiment of the or ^ rcui « nt l^ m hardware k ** form of a frame 

device of the invention; S rabber 10 °P erate ™ lh a «> m P uter - 

FIG. 21 is a plan view of a multiple image sensor of the Referring to FIG. 2, a prior art contact imaging device is 

invention* shown. The optical imaging device provides an analogue 

* . , - ... - 10 output as is common in the art. The output signal is provided 

FIG. 21a is a schematic view of a semiconductor wafer, . c , . .... r ,. . , r t 1A 

... , , o ,. . . riL c to a frame grabber housed within a digital computer 10. 

illustrating the space saving by a finer division of the wafer; ^ m dfawbacks tQ such £ ^pienfentation. 

HG. 22 is a view explaining the use of the alignment ^ the mmpuieT h opened lo install a frame grabber 

pattern; which makes installation and relocation costs high. Second, 

FIG. 23 is a schematic view of an embodiment of the is th e frame grabber occupies an expansion slot or port in the 

device of the invention using a multi-prism; computer thereby reducing computer expandability. Third, 

FIG. 24 is a schematic view of another embodiment using the frame grabber is expensive. These drawbacks in the prior 

a multi-prism; art implementations of imaging devices, also preclude trans- 

FIG. 25 is a schematic view of still another embodiment mining pointing information such as that provided by a 

using a multi-prism; and, 20 computer mouse and image information as a single signal or 

FIG. 26 is a schematic view of still another embodiment as multiplexed signals without a custom frame grabber, 

of the invention. This apparatus comprises a light source 1 and a diffuser la 

for emitting a light beam to the subject fingertip "F\ A 

DETAILED DESCRIPTION triangular prism 2 includes a slant surface 2a of about 45 

Referring to FIG. 1, a schematic view shows the con- 25 degrees inclination angle on which the fingertip "P" is laid, 

struction of a representative embodiment of a known type of Throughout the disclosure and claims, finger is defined to 

optical apparatus. This apparatus comprises a light source 1 include a finger or a thumb. An image producing lens system 

and a diffuser la for emitting a light beam to the subject 3 is provided for receiving the reflected light beam from the 

fingerprint "P". A triangular prism 2 includes a slanted valleys of the subject fingerprint laid on the prism 2 and then 

surface 2a of about 45 degrees inclination angle on which producing an image of the subject fingerprint "P" at an area 

the fingerprint "P" is laid. An image producing lens system CCD 4; the apparatus further includes a signal processing 

3 is provided for receiving the reflected light beam from the circuit 5a for amplifying the electric signal provided by the 

valleys of the subject fingerprint laid on the prism 2 and then area CCD 4 > and a frame grabber 6a installed within a 

producing an image of the subject fingerprint "P" at an area 3S computer 10 for digitising the signal provided by the CCD 

charge coupled device 4 (hereinafter, referred to simply as and providing a digital representation of the image to the 

"the area CCD") for converting the produced fingerprint computer 10. 

image into an electric signal; the apparatus further includes Referring now to FIG. 3, a computer mouse 24 compris- 

an amplifying/analysing circuit 5 in the form of a signal ing an optical fingerprint imager according to the invention 

processing circuit for amplifying then analysing the electric 4Q is shown. The mouse comprises a position detecting device 

signal for the subject fingerprint provided by the area CCD in the form of two position sensors 21, an idler wheel 22, and 

4, and a monitor 6 for displaying the fingerprint image a ball 23 for engaging a surface on which the mouse is 

shown. The transparent triangular prism 2 can be made of placed and for rotating in relation to mouse movement along 

glass or another suitable material. Other prism shapes such the surface. Construction and design of pointing devices is 

as polygonal e.g. tetragonal may also be employed. The 45 well known within the art. 

index of refraction of the prism material is preferably in the Within the computer mouse 24 is housed an apparatus for 

range of about 1-2. imaging fingerprints. The apparatus comprises a light source 

The prism 2 has a fingerprint receiving face 2a, upon 11 and a diffuser 11a for emitting a light beam to the subject 

which a finger is placed (indicated by fingerprint P). Fingers fingerprint "P". A triangular prism 12 includes a slant 

are known to incorporate fingers and thumbs. A fingerprint 50 surface 12a of about 45 degrees inclination angle on which 

viewing face 16 is disposed at an acute angle, typically of the fingerprint "P" is laid. An iris 15 disposed between the 

about 45—50°, to the fingerprint receiving face 2a. This prism and an image producing lens system 13 increases the 

permits a larger viewing surface and a sharper viewed image depth of field and thereby improves image quality. The 

than prior art devices. Two opposed parallel faces are image producing lens system 13 is provided for receiving 

perpendicular to the fingerprint receiving face 2a. 55 the reflected light beam from the valleys of the subject 

The light source 1 is in the form of a multi-light emitting fingerprint laid on the prism 12 and then producing an image 

diode (LED) array, although other conventional light of the subject fingerprint "F* at an area CCD 14; the 

sources are also known. A suitable LED array is one of is the apparatus further includes a circuit 19 for providing a signal 

type described in U.S. Pat. No. 5,210,588 comprising a in dependence upon both the mouse position detecting 

number of high intensity ultra-luminescence chips, which 60 circuit output signal and the CCD 14 output signal. The 

provides a light intensity of about three (3) times that of systems incorporated within the mouse of FIG. 3, are 

common LEDs. The disclosure of U.S. Pat. No. 5,210,588 is described in more detail below. 

incorporated herein by reference. Referring to FIG. 4, an imaging device for incorporation 

CCD image sensors provide an electrical signal represen- into an embodiment of the invention is shown wherein a 

tative of a captured image. Image sensor circuit diagrams for 65 diaphragm is placed at the focal point of the lens to increase 

CCD image sensors are shown for example on semiconduc- the depth of field and to lessen Gaussian distortion. In 

tor data sheets provided by manufacturers of semiconductor attempting to shorten the distance "d" between the prism 12 
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and the CCD detector 14 to achieve a more compact device, 
optical limitations of conventional fingerprint arrangements 
such as the one shown in FIG. 1 become more exaggerated 
and hence, more limiting. For example, as the distance "d" 
is decreased, the depth of field within the system decreases; 5 
thus the focusing requirements become more stringent. This, 
of course, places increased limits on acceptable tolerances of 
the optical components and their respective placement. 
Conversely, as the depth of field increases, the task of 
focusing a fingerprint image on a CCD array becomes less 10 
complex. One aim of this invention is to provide a compact, 
easy to assemble and manufacture fingerprint device. At the 
same time, it is also preferred to lessen the cost of such a 
device by using a relatively inexpensive, commercially 
available optical lens or optical lens arrangement. It should ^ 
be noted, that the diaphragm 15, shown in FIG. 4 has an 
extremely small opening. In fact, it is unlikely that this 
opening would provide enough light for the CCD array to 
detect an image; however, in theory, it is preferred to have 
a small fixed opening with the proviso that enough light be 2 o 
present at the CCD array 14 to detect a suitable image. If the 
depth of field is not increased sufficiently to cover the 
difference in path lengths between Dl and D2 (see FIG. 1), 
the CCD 14 can be tilted to more sharply focus of the image. 

Referring now to FIG. 5, a symmetric bi-convex lens is 25 
shown exhibiting Gaussian optical distortion. As can be seen 
from the figure, light travelling through the lens at varying 
distances from the optical axis (various f-ray numbers) does 
not focus at the same point on the paraxial image plane. This 
aberration can cause light from a same feature area within a 30 
fingerprint being imaged, to fall on more than one pixel of 
the CCD, causing the print imaged by the CCD to appear 
blurry or out of focus. More costly achromat lenses are 
available which correct for this problem, however this 
significantly adds to the cost of manufacture of the finger- 35 
print device. Constraining the light to within a smaller radius 
about the centre of the lens, i.e. eliminating low ray 
f-numbers results in a significant improvement in image 
quality detected by the CCD array. The diaphragm 15 shown 
in FIG. 5 essentially blocks out light from reaching the outer 40 
periphery of the lens, and reduces the Gaussian distortion of 
the inexpensive bi-convex lens 13. Thus, the provision of the 
diaphragm 15 both increases the field of view and reduces 
distortion at the lens edge. Of course the amount of light 
received by the CCD is reduced by blocking some of it with 45 
the diaphragm 15, therefore the amount of light about the 
finger resting on the prism must be sufficient for adequate 
detection by the CCD. The location of the diaphragm or 
aperture is important and is related to the size of the aperture. 
A large aperture, allowing light to reach the entire preferred 50 
useable portion of the lens, is, optionally, located on the lens 
or two (2) focal distances away. Smaller apertures would 
need to be placed closer to the focal point based on linear 
ratio. Thus, an aperture half the size of the large aperture 
would ideally be located between 0.5 focal lengths and 1.5 55 
focal lengths from the lens. Locating such an aperture 
outside these distances results in some loss of information. 
The simplest form of acceptable aperture is an opaque 
surface or coating applied directly to the outer portion of the 
lens 13 as is shown in FIGS. 6 and 7. so 

Referring now to FIGS. 6 and 7, a very short and compact 
device is shown in accordance with a preferred embodiment 
of the invention. Conveniently, the device is compact 
enough to be packaged into a hand held instrument about the 
size of a computer mouse, for attachment to a personal 65 
computer, wherein many commercially available devices are 
several times larger. A lens 13 is disposed between a prism 
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12 and CCD 14. A diaphragm 15 in the form of a coating, 
decal, or paint is applied to the periphery of the lens 13, thus 
obviating the requirement shown in previous embodiments 
of this invention, for precisely positioning a diaphragm 
between the lens and the prism. Furthermore, by applying 
the diaphragm directly to the lens, there is no longer a 
requirement for affixing and holding in place a discrete 
diaphragm component. Only the lens 13 need be held in 
place between the CCD 14 and the prism 12. 

The system geometry shown in FIG. 6 has proven to work 
successfully, producing substantially clear images at the 
CCD 14. A plano-convex lens 13 is used having a focal 
length of approximately 6 mm. The CCD array 14 has a 
pixel element size of approximately 10x10 /an. The iris 
diameter of the diaphragm was selected to be 1 mm. The 
distance from the lens face to the prism back face is 
approximately 5 cm. The distance from the lens to the CCD 
face is approximately 1 cm. Preferably, the CCD 14 is tilted 
as shown at an angle of 5° with respect to the lens back face. 

A biometric input device incorporated into a pointing 
device such as a computer mouse according to the present 
invention is designed to be used with a computer in the form 
of a personal computer. The input device is for interfacing 
with one of several industry standard or proprietary com- 
puter peripheral interfaces. 

Referring to FIG. 8, a simplified block diagram of a 
biometric imaging device with a parallel pass through is 
shown. The imaging means comprises a prism 12 having a 
surface 12a for contacting a fingertip, a lens 13, and a CCD 
array 14 for imaging incident light. A processor 50 converts 
an analog signal provided by the CCD 14 to a digital signal. 
A pointing device in the form of a mouse 20 housed within 
a same housing as the optical imaging means provides a 
signal in dependence upon relative position of the mouse to 
the processor module 50. Pointing devices are well known 
in the art. The processor module 50 provides a signal in 
dependence upon the relative position information and the 
digital signal to a pass through module 750. The signal is a 
combination of the digital signal and the position informa- 
tion formed by multiplexing the information into a third 
signal. Alternatively, the third signal is formed by encoding 
the digital signal with position information in a predeter- 
mined fashion. The pass through module 750 is connected to 
a peripheral port 900 on a computer 10 via a communication 
means in the form of a cable 700 and allows further digital 
devices to be connected via the pass through module 750 to 
the same port. A printer 756 is shown connected to the 
computer via the pass through port 750. The use of a single 
port for multiple devices is desirable as it increases flex- 
ibility and expandability of computer systems. Alternatively, 
a pass through port is not used and the apparatus according 
to the invention occupies a single port on the computer 10. 

Referring to FIG. 9, a detailed block diagram of an 
embodiment of the invention is shown. A CCD 14 is used to 
capture an optical image in the form of a fingerprint image. 
The CCD 14 is driven by a high voltage driver circuit 68. 
Address and decoding circuitry 78 provides control signals 
to the high voltage driver and acts to gate image information 
output from the CCD 14 through an analog to digital 
converter 28 and onto a data bus. The address decoding 
circuit 78 is driven by a processor 500 in the form of a 
micro-controller and is connected to an address bus. The 
micro-controller operations are performed in accordance 
with a predetermined instruction set stored in RAM 400. 
Alternatively the instruction set is stored in ROM (not 
shown). A buffering and protocol conversion circuit 800 
allows information from the data bus to be output directly to 
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a parallel or serial digital input port present in a computer. The connection means 900 is selected to mate with a 

One such input port is a parallel port. Different buffering and connector on a computer with which the imaging device is 

protocol conversion circuits are used with different digital to be used. It is anticipated that such a connector mates with 

ports. industry standard ports for parallel or serial com muni ca- 

Alternatively, the buffering and protocol conversion cir- 5 tions. Some examples of ports include Geoport®, Apple 

cuit 800 is a pass through serial port circuit. Such a circuit Desktop Bus®, parallel port, RS232 port, IRDA, game port 

allows the connection of a plurality of devices to a single an d universal serial bus port. Portability is enhanced when 

computer peripheral port. The circuit operates to allow other me port ^ accessible when the computer is installed and in 

peripherals connected to the port to operate normally while use 

me image capture device is not in use. During use, however, in A . . . 4 . 4 „ . . 4 . , . , 

the ima|e capture device assumes control of the port and 10 u Alternatively, the micro-controUer circuitry is designed so 

prevents normal operation of other peripheral devices. For ^ P">g™»ming is provided after power up via a predeter- 

use with a pointuVg device, serial devices experience a mmed f ort °° ^ ^mputer 10. Programming in this fashion 

reduction in performance for long data transfers because ' s Permed by a host computer executing software 

a -™ ^ ™ r v „ l- tT • - t<r designed to program the micro-controller 50 via the prede- 

pomting device sampling is a nigh priority operation. , c . j ^ & ™_ . ■ * • 

^ . . A „ ¥ _ ^ A ° . - . , . 15 term in ed port on the computer 10. The design or micro- 

R'fernng to FIG. 10, the buffenng and protocol conver- oonBoner F cireilitB lhat are programmed for/remote pro- 

swn circuit 800 compnses a paralkl pass through circuit. cessoR 0f ^ ters ^ ^ bo un iike ,be 

Tie ctrcuit comprises 2x1 multiplexers 803 for allowing ^ oflen ^ 

processor controlled switching of a penpbera por data bus 'j,^,,,^, drcuit t0 , gate p redelerm ined interface 

810 to other peripheral devices (and therefrom) or lo a , n . t , , n ~ „ , . ne^i 

. . 4 . . » j . « . . ' s 20 such as a standard PC parallel port or an RS232 port, 

biometnc imaging device according to the present invention. r r r 

The addition of a buffer (implemented using processor In the mousc comprising a biometric input device is 

control logic and the RAM) allows for the biometric imag- coupled to a computer. The computer is turned on and the 

ing device to buffer signals from other devices while trans- device is Powered from the computer's power source, 

ferring information in the form of relational position infor- „ Alternatively, the device may be provided with a separate 

mation and imaging information to the peripheral port data P ower source - ^ micro-controller within the device is 

bus. Alternatively, the pass through buffers imaging infor- programmed and begins sampling the mouse position sen- 

mation. Further, by monitoring control signals from the and analyzing digital images provided by the analog to 

peripheral port in an unswitched fashion, the device is dl S ltal conversion circuitry means for an image in the form 

capable of receiving control information while other periph- 30 of a fin S er P rint - While no is detected, the mouse 

erals are in use. This form of monitoring requires multiplex- P oslllon information is provided to the computer at intervals, 

ers for a peripheral port data bus 810 carrying information a desirable image is detected, an interrupt is generated 

to the peripheral port from peripheral devices and does not on the computer to allow for a data transfer to take place, 

require multiplexers for a peripheral data bus carrying When dala transfer occupies a very short duration, 

information to the peripheral devices from peripheral port. 35 sampling of the mouse position sensors during data transfer 

Optionally, buffers are used for information to the peripheral B unnecessary. When the image data transfer is lengthy, the 

devices from peripheral port in order to increase distance mouse position sensors are sampled at intervals and the 

and quantity of peripheral devices connected to a single information retrieved is encoded into the image data by 

peripheral port replacing unused pixels, adding extra data at intervals, or 

In an embodiment, the relative position information is 40 a ™therdata encoding scheme Alternatively, an indication 

encoded into individual image frames in the form of inter- ^her than an interrupt is used to commence image data 

mittent information, header information, or in place of rans er " 

predetermined pixels at, for example, the periphery of the Software executing within the computer may use the 

image. In order to accomplish this, the mouse position digital image as a data input signal for user authorization, or 

sensors are sampled by the microcontroller 500 at intervals. 45 for another purpose. Preferably, when used for user or task 

The position sensors' values at each interval is encoded into authorization such as root level access to a computer 

image data. This is accomplished, for example, by inserting network, such a device is designed for portability and is easy 

the position information at the beginning of each row of lo install and remove from the computer, 

pixel values. Typically, CCDs for use with this device require 0.25 

Further, the use of microcontroller 500 allows for chang- 50 seconds to transfer an analog electronic image to the analog 

ing of the predetermined port to one with a different con- to digital conversion circuitry means. The first 0.25 seconds 

nector or configuration with only minor modifications such wherein a finger print is delected by the micro-controller (as 

as changing the programming stored in non-volatile well as the last 0.25 seconds) may result in a poor quality 

memory. Also, the encoding of the position information is digital image where the finger tip was moving and was only 

alterable with similar modifications. Alternatively, the 55 present on the device for a small portion of the 0.25 seconds, 

means comprises dedicated circuitry for transmitting the Further, finger tip positioning changes during contact which 

image in a digital form. results in different digital images of a single finger tip. To 

The carrier means 700 is in the form of a cable, radio overcome this problem, a time series averaging technique is 
transmission, or infrared transmission. Such carriers are applied to each of the digital images provided to the micro- 
known in the art. When a non-physical carrier such as radio 60 controller in order to build a composite image of the 
or infrared emissions is used, a suitable receiver is required fingerprint that will be better quality than any one print 
connected to or integrated with the computer. Such a con- image on its own. Time series averaging is known in the art 
figuration enhances portability by requiring no physical of digital image processing. Alternatively, the micro- 
connection to the imaging device; however, where the controller can select a digital image based on a predeter- 
suitable receiver is not a common feature of installed 65 mined selection criteria. 

computers, a receiver would then be necessary for every FIGS. 11, 12, and 13 show the ergonomically designed 

computer with which the imaging device may be used. hand held device that contains the circuitry shown in the 
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previous figures. By reducing the length of the optical path puter. The amount of image data is determined in 

in the manner shown, this small hand held device is realis- dependence upon a reasonable interval for sampling position 

able and may be manufactured at a relatively low cost, using data. Alternatively, the amount of image data is determined 

an inexpensive lens. in dependence upon a horizontal or vertical scan line in the 

Although white light may be used, it is preferable to 5 image. When the image data is transferred a determination 

employ a monochromatic light source. Red light of a wave- of frame location is made. When the frame is completed, a 

length in the range of 700-800 nm is most preferred, since new frame P ulse is transmitted and the method repeats, 

this wavelength range is at the highest response region of the Alternatively, when the frame is not complete, a separator is 

conventional electronic imaging devices used. Illumination transmitted to the computer followed by position data, 

in the range of 0.5 to 2.5 lux has been found to be effective. 10 Referring to FIG. 18, a simplified flow diagram of a 

Referring to FIG. 14, a mouse comprising a position further method of encoding information employing two 
sensing means and a capacitive contact imaging means is modes is snown - When an * present, a similar method 
shown. The mouse housing 24 houses both means. The t0 that described above is followed. Alternatively, when an 
mouse comprises a position detecting device in the form of i^ge k present only image data is transferred and no 
two position sensors 21; an idler wheel 22, and a ball 23 for 15 position data is multiplexed therein. When no image data is 
engaging a surface on which the mouse is placed and for present or requested, only position information is trans- 
rotating in relation to mouse movement along the surface. ferred - A header for each image indicates the presence of 
Construction and design of pointing devices is well known ima g e data or position data during a single frame, 
within the art. In yet another embodiment suitable for use in a trackpad 

Within the housing 24 is an apparatus for imaging fin- 20 embodiment, a resolution of the imaging device is reduced 

gerprints. The apparatus comprises a capacitive sensing for pointing device operation. A frame pulse or header 

array 14b onto which a subject fingerprint "TIP* is laid. indicative of pointing device operation mode is transmitted 

Addressing circuitry samples each array element within an with a low resolution image. The image is analysed by the 

array on the capacitive plate to determine a voltage or computer to determine position information for an object on 

current value. The values are then digitised and provided to 25 lhe contact imaging device. When an image is requested, a 

a circuit 19. The apparatus further includes a circuit 19 for ni g h resolution image is transferred to the computer and 

providing a signal in dependence upon both the mouse position information is not transferred until the image is 

position detecting circuit output signal and the capacitive completely transferred. 

sensing array 14b output signal. The systems incorporated 3Q In yet another embodiment of the invention, images are 
within the mouse are similar to those described above. stored in buffers within the pointing device and are trans- 
Referring to FIG. 15, a trackpad is shown incorporating a mining continuously during periods between position data 
contact imaging device. The trackpad is formed of a capaci- transfer in order to occupy periods of non use of the 
tive contact imaging device. The location of a fingertip on computer peripheral port. 

the surface of the trackpad is provided to a computer 35 In yet another embodiment suitable for incorporation into 
encoded within image frames according to the invention. a trackpad, a small array within an image is transmitted at 
The image of the fingertip resting on the trackpad is pro- high resolution when a fingerprint is provided thereto. A 
vided to the computer when available. With frame transfer value indicative of the location of the array is also trans- 
rates supported by existing COM and LPT ports on PC mitted to the computer for use as position data. Such an 
compatible computers, data transfer rates require approxi- ^ embodiment is particularly applicable to large surface area 
mately 0.2 to 0.5 seconds to transfer a fingerprint image via trackpads wherein finger tip location on the trackpad deter- 
such a port. Pointing devices in the form of trackpads mines position and imaging of the finger tip is also per- 
provide rapid response to user actions and, therefore, are not formed. 

well suited to providing information as infrequently as one Referring to FIGS. 19 and 20, an embodiment of an 

or two times per second. 45 optical contact imager for use in the present invention is 

Alternatively, as shown in FIG. 16, the trackpad 120 shown. The embodiment shown reduces contact imager size 

comprises an optical contact imaging device according to considerably by using a plurality of CCDs to image a 

the invention. Again, bandwidth limitations of computer fingerprint. 

peripheral ports require provision of location or position As illustrated in FIGS. 19 and 20, the height of an optical 

information at intervals during image transfer. Several meth- 50 fingerprint imager is a function of a trapezoid formed by the 

ods are envisaged for accomplishing this. These methods CCD at one base thereof and the lens at the other base 

provide trackpad position information and image informa- thereof, assuming lenses of comparable focal power. As can 

tion to a same peripheral port of a computer. This "multi- be seen in FIG. 19 in comparison with FIG. 20, the large 

plexing" of data is now described with reference to FIGS, 17 base (the diameter of the lens 13) gives rise to a large 

and 18. 55 trapezoid 71 compared to the two trapezoids 157 defined by 

Referring to FIG. 17, a simplified flow diagram of a the lenses 13c and the corresponding CCD arrays 14c. 

method of encoding information is shown. A standard mul- In the optical system of FIG. 20, only two lenses 13c are 

tiplexing technique is used to transmit position data and shown. Actually, in order to better cover the beam reflected 

image data simultaneously. A frame pulse, indicates the from the object and passing through the viewing surface of 

beginning of a frame. Frame pulses and digital sequences 60 the prism 12, the system has four lenses, each defining a 

used for frame pulses are known in the art of communica- separate optical path. These four separate optical paths are 

tions. Immediately following the frame pulse, position data formed by the use of four lenses and four corresponding 

is provided to the computer. Following the position data, a CCDs 14c. All the lenses have a focusing length such as to 

separator is provided to the computer, alternatively, no focus their part of the image (a subimage) in a focal plane 

separator is used when synchronisation between the com- 65 in which the corresponding CCD element is disposed. In 

puter and the pointing device is established. A predeter- FIG. 20, the focal plane is common for all the lenses 13c; as 

mined amount of image data is then provided to the com- will be discussed hereinbelow, this is not always necessary. 
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The CCDs 14c may be smaller than the CCD 14 of FIG. FIGS. 23, 24 and 25. The staircase-shaped prism, shown in 

19 and still maintain the resolution of the CCD 14, or they a side view, may be designed in a single piece or as a 

may be of equivalent size to the size of the single CCD 14 plurality of small prisms 281 secured to a common backing, 

and thus increase resolution substantially. In either case, the As seen in FIG. 23, each small prism 281 is illuminated with 

total size of the optical imaging device of FIG. 20 is reduced 5 a portion of the light emitted by the source 1, and the light 

compared to that of FIG. 19 for the resolution obtained. is reflected from an object, e.g. a fingerprint pattern, shown 

The number of lenses is not limited to four. According to in FIG. 19, applied to the slanted face of the prism 261. The 

the invention, any practical plurality of lenses disposed such reflected light passes through the viewing faces 301 onto 

as to focus a part of the reflected light carrying the image of image sensors 321, each having a lens 341 applied directly 

the object may be employed. 1Q thereto to simplify the design and to minimize the size of the 

It is known in the art that the pattern of electrical charges device. The analyzing circuit and the display are not illus- 

created on CCD chips can be transmitted sequentially out of trated. 

the chip to be reassembled by an analyzing circuit e.g. on a A somewhat different embodiment is illustrated in FIG. 

readout screen. According to the present invention wherein 24, the difference being in that the single source of light 1 

a plurality of chips is employed, it is advantageous to is replaced by separate light sources 361 applied directly to 

provide alignment marks on separate sub images to assist in 15 the illuminating ("bottom") surfaces of the small prisms 

a precise reassembly of the separate subimages into a true 281. 

picture e.g. a fingerprint image. Such alignment marks, as It will be recognized that the embodiment of FIG. 23 
illustrated in FIG. 21, may take the form of crosshairs or gives rise to some banding. The light beam emitted by the 
other indicia. To create such alignment marks 221 on an ^ source 1 towards the slanted face of the multi-prism 261 is 
image sensor, a reticle is provided on at least one of the partially obscured by the CCD/lens sets 321, 341. The 
lenses. The sub-beam carrying a subimage is then also resulting shading creates banding on the sub-images pro- 
transmitting the reticle (e.g. crosshairs) into the correspond- vided by the CCDs 321 on the display. This drawback is a 
ing image sensors (area CCDs 241). Knowing the predeter- trade-off for a significant reduction in size of the design of 
mined positioning of the reticle (crosshairs) on the lens or ^ FIG. 23 as compared with the conventional design of FIG. 
lenses, it is easy for those skilled in the art to reassemble the 19. It will be noted that the design of FIG. 24 does not 
image on the display screen. The fact that the image will eliminate the shading completely, but it does contribute to 
carry the corresponding alignment reticle or indicia is either space saving as it eliminates the outside light source in favor 
very important or secondary, depending on the application. of "integrated" sources of light 361. 
For the purpose of simply determining a presence or absence 3Q In the embodiment of FIG. 25, shading by the lenses and 
of a pattern such as a fingerprint, the presence of alignment CCDs is eliminated at the expense a somewhat larger overall 
lines may well be negligible or of minor importance. It size of the setup. It will be noted that the overall size still 
would of course disqualify a video film or the like. offers a reduction in size over the conventional design of 
FIG. 21 shows the four chips 241 assembled in a common FIG. 19 owing to both the staircase prism design and the 
plane to receive the subimages from the four lenses 13c of 35 reduction of the distance between the lenses and the image 
FIG. 20, the focal length of all the four lenses being sensors (CCDs). 

identical. As will be demonstrated hereinbelow, this is not a In the above -discussed embodiments of FIGS. 20, 23, 24 

prerequisite. However, FIG. 21 is an example of a better use and 25, the prism is a right-angle prism or is comprised of 

of the wafer. It is, arguably, more economical to cut four a plurality of right-angle sub-prisms 281. It is conceivable to 

small chips (shown on the right side of FIG. 21a) and to 4Q employ prisms with sharp or obtuse angles between the 

attach them to a common backing for the purpose of the illuminating surface and the object viewing face, 
embodiment of FIG. 20 (elements 14c) than to manufacture i t ^1 be apparent to those of skill in the art that capacitive 

a single large chip equivalent to the size of four chips 241. transducers for use in the capacitive contact imaging device 

FIG. 22 illustrates how two subimages can be reas- described herein, can also be assembled in arrays to reduce 

sembled by aligning their common features in the form of 45 manufacturing costs, increase manufacturing yields, and 

crosshairs lines. prevent breakage during use. Alternatively, a glass plate is 

It will be noted that the subimages can be assembled in an etched with capacitive pads for use in a capacitive contact 

abutting manner or with an overlap. As remarked above, any imager and the integrated circuit for sampling the state of the 

small deterioration of the image quality may be secondary pads is located within the pointing device below the glass 

for the purpose of identifying the presence or absence of a 50 plate. 

pattern (e.g. a fingerprint), a predetermined design or mark. In a further embodiment shown in FIG. 26, the contact 

As discussed in conjunction with FIGS. 19 and 20, it will imager in the form of an optical contact imager is provided 

be appreciated that the provision of four lenses 13c instead with a switch 44 for enabling or disabling imaging opera- 

of one lens 13, may shorten the optical path between a lens tions. Preferably the contact imager is movably housed 

and the corresponding CCD chip by 50%, subject to the 55 within the housing and biased by a biasing means 43 toward 

comparability of the optics. By the same token, the single the outside of the housing. Pressure from a fingertip in 

lens 13 of FIG. 19 may be replaced by another number of contact with the contact imager, enables the contact imager 

lenses, e.g. nine, in a side-by-side or an overlapping pattern, and, therefore, results in an image being captured and 

to cover the beam of light reflected from the object under provided to the microcontroller circuit. Absent contact with 

investigation. It will be evident to those skilled in the art that 60 the imager, no image is captured and the microcontroller 

an arrangement with nine lenses would result in the short- receives only position data. In this embodiment, the reduc- 

ening of the optical path between a lens and the correspond* tion in information provided to the microcontroller results in 

ing image sensor by 66.7%. Such shortened optical paths provision of image information to the computer when desir- 

will in turn result in a reduction of the overall dimensions of able and reduces data transfer to the computer via the 

the device. 65 computer peripheral port. 

In exemplary embodiments of the invention, a conven- In yet another embodiment, the pointing device comprises 

tional prism is replaced by a multi-prism 261 shown in means for analyzing the image information to determine 
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whether or not a desirable image is present therein. The 
means for analyzing acts as a switch preventing image 
information corresponding to undesirable images from 
being provided to the computer. 

Of course, numerous other embodiments may be eovis- 5 
aged without departing from the spirit and scope of the 
claimed invention. 

What is claimed is: 

1. An apparatus for providing fingerprint imaging infor- 
mation and positional information for use with a computer, i° 
comprising: 

a housing; 

a pointing device housed within the housing and for 
providing a first signal in dependence upon location; 
a contact imager housed within the housing and having a 
surface for accepting fingerprint information and for 
providing a second signal corresponding to detected 
fingerprint information, the contact imager comprising: 
a source of light for illuminating an object to be imaged 2Q 
so that a light beam derived from said object and 
carrying its image is formed; 
a prism having a plurality of illuminating surfaces for 
illuminating said object with said light source and 
having a plurality of viewing faces corresponding to 25 
said illuminating surfaces for transmitting there- 
through said light beam derived from said object; 
image focusing means for dividing said derived light 
beam into a plurality of sub-beams carrying subim- 
ages of said object, and for focusing each of said 3Q 
sub-beams on a focal plane; and, 
a plurality of image sensors corresponding to said 
plurality of sub-beams, each image sensor disposed 
in a focal plane corresponding to one of said sub- 
beams, for receiving and converting a corresponding 35 
subimage into an electric signal; and, 
means for accepting the first signal and the second signal and 
for combining and/or multiplexing information from the first 
signal and the second signal to provide a third signal to the 
computer. 4Q 

2. An apparatus for providing fingerprint imaging infor- 
mation and positional information for use with a computer 
as defined in claim 1, wherein the image focussing means 
comprises a plurality of lenses corresponding to the plurality 
of viewing faces. 45 

3. An apparatus for providing fingerprint imaging infor- 
mation and positional information for use with a computer 
as defined in claim 1, wherein the contact imager comprises 

means disposed between the viewing faces of the prism 
and the lenses for preventing light propagating from the 50 
prism in the direction of the lens from reaching a 
portion of the lens about its outer edge. 

4. An apparatus for providing fingerprint imaging infor- 
mation and positional information for use with a computer 

as defined in claim 1 wherein the housing and pointing 55 
device form a computer mouse. 

5. An apparatus for providing fingerprint imaging infor- 
mation and positional information for use with a computer 
as defined in claim 1 wherein the means for accepting the 
first signal and the second signal and for providing a third 60 
signal to the computer in dependence upon the first and 
second signals comprises: 

an analogue to digital converter for converting the second 

signal into a digital signal; and, 
a microcontroller for accepting the digital signal and the 65 

first signal and for providing a third signal to the 

computer. 



6. An apparatus for providing fingerprint imaging infor- 
mation and positional information for use with a computer 
as defined in claim 5, wherein the third signal is formed by 
multiplexing the first signal and the digital signal together. 

7. An apparatus for providing fingerprint imaging infor- 
mation and positional information for use with a computer 
as defined in claim 5, wherein the third signal is formed by 
encoding a variable amount of information of the first signal 
into the second digital signal according to programming of 
the micro-controller. 

8. An apparatus for providing fingerprint imaging infor- 
mation and positional information for use with a computer, 
comprising: 

a housing; 

a pointing device housed within the housing and for 
providing a first signal in dependence upon location; 
a contact imager housed within the housing and having a 
surface for accepting fingerprint information and for 
providing a second signal corresponding to detected 
fingerprint information, the contact imager comprising: 
a source of light for illuminating an object to be imaged 
so that a light beam derived from said object and 
carrying its image is formed; 
a prism having a plurality of illuminating surfaces for 
illuminating said object with said light source and 
having a plurality of viewing faces corresponding to 
said illuminating surfaces for transmitting there- 
through said light beam derived from said object; 
image focusing means for dividing said derived light 
beam into a plurality of sub-beams carrying subim- 
ages of said object, and for focusing each of said 
sub-beams on a focal plane; and, 
a plurality of image sensors corresponding to said 
plurality of sub-beams, each image sensor disposed 
in a focal plane corresponding to one of said sub- 
beams, for receiving and converting a corresponding 
subimage into an electric signal; 
an analogue to digital converter for converting the second 
signal into a digital signal; and, a micro-controller for 
accepting the first signal and the second digital signal and for 
combining and/or multiplexing information from the first 
signal and the second signal to provide a third signal to the 
computer. 

9. An apparatus for providing fingerprint imaging infor- 
mation and positional information for use with a computer, 
comprising: 

a housing; 

a pointing device housed within the housing and for 
providing a first signal in dependence upon location; 
a contact imager housed within the housing and having a 
surface for accepting fingerprint information and for 
providing a second signal corresponding to detected 
fingerprint information, the contact imager comprising: 
a source of light for illuminating an object to be imaged 
so that a light beam derived from said object and 
carrying its image is formed; 
a prism having a plurality of illuminating surfaces for 
illuminating said object with said light source and 
having a plurality of viewing faces corresponding to 
said illuminating surfaces for transmitting there- 
through said light beam derived from said object; 
image focusing means for dividing said derived light 
beam into a plurality of sub-beams carrying subim- 
ages of said object, and for focusing each of said 
sub-beams on a focal plane; and, 
a plurality of image sensors corresponding to said 
plurality of sub-beams, each image sensor disposed 
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in a focal plane corresponding to one of said sub- 
beams, for receiving and converting a corresponding 
subimage into an electric signal; 
an analogue to digital converter for converting the second 
signal into a digital signal; and, a micro-controller for 
accepting the first signal and the second digital signal and for 
detecting a presence of a fingerprint image within the second 
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digital signal received and, when a fingerprint image is 
detected within the second digital signal, providing the 
image information to the computer and, when a fingerprint 
image is not detected, providing the first signal to the 
computer. 



05/06/2004, EAST Version: 1.4.1 



